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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERiOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 
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Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )[3 Responsive to communication(s) filed on 5/6/04 . 
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8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 
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Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
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Priority under 35 U.S.C. § 119 

12)n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)n All b)n Some * c)^ None of: 

1 Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received In Application No. . 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) □ Notice of References Cited (PTO-892) 

2) n Notice of Draflsperson's Patent Drawing Review (PTO-948) 

3) D Infomiation Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 

Paper No(s)/Mail Date . 



4) n Interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) n Notice of Infoimal Patent Application (PTO-152) 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mail Date 07 



Application/ControWumber: 09/81 3,71 1 ^ Page 2 

Art Unit: 2655 

DETAILED ACTION 



Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 
U.S.C. 102 that form the basis for the rejections under this section made in this 
Office action: 

A person shall be entitled to a patent unless - 



(e) the invention was described in (1) an application for patent, published 
under section 122(b), by another filed in the United States before the 
invention by the applicant for patent or (2) a patent granted on an 
application for patent by another filed in the United States before the 
invention by the applicant for patent, except that an international 
application filed under the treaty defined in section 351(a) shall have the 
effects for purposes of this subsection of an application filed in the United 
States only if the international application designated the United States 
and was published under Article 21 (2) of such treaty in the English 
language. 



1. Claims 1-4,6,9-16,18-23,25,28-34,36-41 & 43 are rejected under 35 
U.S.C, 102(e) as being anticipated by Kanevsky et al. (U.S. Patent 6529871). 
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Regarding claims 1&13, Kanevsky et al. disclose a method and system 
that is comprised of a speech-processing system/ 
apparatus/device/software (collection of methods) that resides in the 
memory of a computer system (Col 5, Line 50 - Col 6. Line 7). 

Kanevsky et al. disclose the building of user databases [claimed PIM 
database] and models by using an enrollment process that collects 
personal information (e.g. name, address, etc) from the user (Col 8, 30 - 
51). The system contains non-acoustic and acoustic models (language 
models) for many users (Col 7, Line 62 and Col 8, Line 64); 



Kanevsky et al. disclose a learning algorithm for building user model that 
include the response to queried information from operators, informational 
forms, email forms, web based forms or Integrated Voice Response (IVR) 
systems (Col 7, Line 64 - Col 8, Line 7). This data is stored together with 
the acoustic models (language models) collected by a speech recognition 
system (Col 8, Line 65). When the user calls the central server to gain 
access, the users acoustic features extracted by an automatic speech 
recognition (ASR) application and the non-acoustic data (personal 
information data) in the database is used to help in the determination of 
the identity of the speaker (Col 6, Lines 12 -56). 
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Regarding claim 19, Kanevsky et al. disclose a speech-based processing 
system comprising of a database of PIM data associated with a user (Col 
6, Line 36 - 40); a set of language models (Col 7, Line 60); a language 
model server including a learning unit [learning algorithm] (Col 8, Line 33- 
52), a lookup unit (Col 7, Lines 15-40); a recognition server to recognizer 
utterance of the user (Col 8, Line 13) and a speech application to trigger 
operation of the look-up unit to identify and access a subset of the PIM 
data specified by the utterance using the result of recognizing the 
utterance(Col 7, Lines 30 - 40). 



Regarding claim 28, Kanevsky et al. disclose a speech-based processing 
system comprising of a processor means for executing software (Col 5, 
Line 64 - Col 6, Line 2); and a storage means having stored therein a 
learning unit to learn a set of language models based on a set of PIM data 
and a speech application to access a subset of the PIM data specified by 
a short reference to set to subset uttered by a user(Col 7, Lines 30 - 40). 

Regarding claim 30 & 37, Kanevsky et al. disclose a method of facilitating 
speech recognition comprising of using an automated language model 
learning process to acquire a set of language models based on PIM data 
associated with a user (Col 8, Lines 35 - 51); recognizing an utterance by 
the user by using one of the language model(Col 8, Lines 52 -66); and 



Application/ContfoWumber: 09/81 3,71 1 ~ Page 5 

Art Unit: 2655 

using tlie recognized utterance of the user to identify and access a subset 
of tine PIIVI data(Col 9, Line 2), 



Regarding claims 2,20,31 & 38, Kanevsky et al. disclose the method of 
asking the user random questions [claimed short references] derived from 
the personal database. The data will include portions or a subset of the 
data of the personal information data residing in the PI M/user database 
(Col 6, Lines 41-45). 



Regarding claims 3,15,22,33 & 40, Kanevsky et al. disclose that a new 
user may periodically call the central server where the learning algorithm 
may be activated. The system collects voice samples from the caller's 
answers to the plurality of questions and builds a user voice model which 
will be provided to the system the next time the speaker calls and needs to 
be identified (Col 8, Line 64 - Col 9, Line 5). 



Regarding claims 4,16,23,34 & 41 Kanevsky et al. disclose that a user 
may call the central server where the learning algorithm may be activated 
in real-time to help in the determination of the identity of the user by the 
use of stored language models based on the learning algorithm (Col 7, 
Lines 28 -33). 
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Regarding claims 6.18,25,36 & 43 Kanevsky et al. disclose that the 
language model learning algorithm is based on a statistical language 
model. Kanevsky describes that a user model provided by the leaming 
unit is used to determine the probability of a particular user's identity (Col 
11. Lines 3 -35). 



Regarding claims 9, 10, 1 1,12.14,29,21,32 & 39, Kanevsky etal. disclose 
that the learning algorithm takes data form a plurality of sources, each 
module containing a set of heuristics tailored for acquiring language 
models for one of a plurality of types of PIM data. The data comprises of 
personal address book, personal calendar and email message data. 
Kanevsky et al. describes categories of personal information data. The 
categories include static features which includes phone number, time of 
day, etc (personal address book data), dynamic features which include 
trips, meetings (personal calendar data) and email, faxes, etc. The data 
also includes internal information extracted from dialog that includes 
gender, speech rate, accent etc. and external information such as name, 
address, DOB. etc (Fig 4, Col 10, Lines 42 - 59). 
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Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 102 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 



3. The factual inquiries set forth in Graham v. John Deere Co,, 383 U.S. 1 , 
148 USPQ 459 (1966), that are applied for establishing a background for 
determining obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at 
issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 



5. Claims 5,17,24,35 & 42 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kanevsky et al. (U.S. Patent 6529871) in view of Kremer 
(IEEE 0-7803-4122-8/97). 

Regarding claims 5,17,24,35 & 42, Kanevsky et al. disclose a method and 
system that is comprised of a speech-processing system/ 
apparatus/device/software (collection of methods) that resides in the 
memory of a computer system (Col 5, Line 50 - Col 6, Line 7). The 
system uses personal data to choose language models base on input 
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speech. Kanevsky et al. do not disclose the use of a language model 
algorithm that utilizes grammar induction. However, Kremer teaches a 
grammar induction technique that avoids the limitations of classical 
grammar induction algorithms (Page 1424, Paragraph 1 & 2). Grammar 
induction is a necessary process by which the language models based on 
a finite set of example strings from the PIM data will be used to identify 
grammar, for a potentially infinite set of strings or language. 



Therefore, it would have been obvious to those skilled in the art at the time 
of the invention to modify Kanevsky et al. with the use of language models 
that utilize grammar induction as taught by Kremer since it is essential for 
language models utilized in automatic speech recognition systems. 



4. Claims 7,8,26,27,44 & 45 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kanevsky et al. (U.S. Patent 6529871) in view of Fitzpatrick et 
al. (U.S. Patent Application 20020184033). 

Regarding claims 7,26 & 44, Kanevsky et al. disclose a method and 
system that is comprised of a speech-processing system/ 
apparatus/device/software (collection of methods) that resides in the 
memory of a computer system (Col 5, Line 50 - Col 6, Line 7). The 
system uses personal data to choose language models base on input 
speech. Kanevsky do not disclose the use of an API designed to access 
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PIM data. However, Fitzpatrick et al. teach the use of Standard 
Application Program Interface (API) for integrating other Text-to-Speech 
Servers (Page 4, Paragraph 0116). APIs are important and necessary for 
developers to efficiently integrate large-scale software applications and 
modules. 



Therefore, it would have been obvious to those skilled in the art at the time 
of the invention to modify Kanevsky et al. with the use of APIs as taught 
by Fitzpatrick et al. since it would have made the integration of the 
learning modules with other applications more efficient. 



Regarding claims 8,27 & 45, Kanevsky do not disclose the use of 
providing the PIM data in XML format. However, Fitzpatrick et al. teach 
the use of providing documents in XML format (Page 6, Paragraph 0175). 
XML is a general and highly flexible representation of any type of data. 
XML uniform tags make it easy to map one XML structure to another or to 
map XML into other data formats. 



Therefore, it would have been obvious to those skilled in the art at the time 
of the invention to modify Kanevsky with the use of XML as taught by 
Fitzpatrick et al. since it would have made the data more uniform so that it 
can be transferred and mapped to other types of data. 
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Response to Arguments 

1 . Applicant's arguments filed 5/6/04 have been fully considered but they are 
not persuasive. In regards to claim 1 -4, 6, 9-16, 18-23, 25,28 -34, 36-41 
and 43 stand rejected under 35 U.S.C 102(e) based on U.S. Patent no. 6529871 
of Kanevsky. In addition, claims 5, 17, 24, 35 and 42 will stand rejected under 35 
U.S.C 103(a) based on Kanevsky in view of Kremer (IEEE 0-7803-4122-8/97). 

1 . The office respectfully disagrees that Kanevsky does not disclose or suggest 
automatically learning a set of language models. 

Kanevsky discloses that when a user calls a central server that a name is 
entered into the system. The central server submits the utterance of the 
user's name and request to the automatic speech recognition system that 
decodes the utterance that is used for verification purposes. The 
language model is automatically built from the individual's personal 
information acquired through IVR methods as well as other static and 
dynamic information (Fig 4). The language model in this application is 
unique to a speaker and is built form PIM data. Both speech recognition- 
Information is recognized as well as the speaker recognition- identification 
of the speaker are performed (Col 8, Line 51 - Col 9, Line 5). 
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2. The office respectfully disagrees that Kanevsky does not disclose 
automatically learning a set of language models based on PIM data associated 
with a user. 



Kanevsky in Fig. 4(106,104,108) discloses a PIM database consisting of 
static and dynamic features such as email, calendar & trip information 
similar to what is described by the applicant. The information in the 
database and any new user information added (dynamic) information 
forms the basis for the user's language models (Col 10, Lines 35 - Col 1 1 , 
Line 2). 



3. The office respectfully disagrees that Kanvesky does not disclose then using 
of the user, which has been recognized by using one of the language models 
acquired form the PIM data, to identify and access a subset of the PIM data. 



Kanevsky (Col 10, Lines 50 - Col 11, Line 2) discloses for example, a 
user attempting a remote login to a computer may be asked about when 
an email was received or the sender's name, etc. This information is used 
together with an ASR for decode text and to give access to the computer 
containing a subset or all or the PIM data. 



I 
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All of the applicant's arguments have been considered and addressed in this 
action for all the independent claims. The rejections for all the independent and 
dependent claims will stand. 



Conclusion 



Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Michael A Lewis whose telephone number is 
703 305-8730. The examiner can normally be reached on Monday through 
Friday, 8:30 am - 5 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Doris To can be reached on (703)305-4827. The fax 
phone number for the organization where this application or proceeding is 
assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). 
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